Observer agreement, credibility, and judgment: some considerations in presenting observer agreement data
نویسندگان
چکیده
منابع مشابه
Measurement of observer agreement.
Statistical measures are described that are used in diagnostic imaging for expressing observer agreement in regard to categorical data. The measures are used to characterize the reliability of imaging methods and the reproducibility of disease classifications and, occasionally with great care, as the surrogate for accuracy. The review concentrates on the chance-corrected indices, kappa and weig...
متن کاملObserver Agreement for Event Sequences 1 Running head: OBSERVER AGREEMENT FOR EVENT SEQUENCES Observer Agreement for Event Sequences: Methods and Software for Sequence Alignment and Reliability Estimates
When sequences of discrete events, or other units, are independently coded by two coders using a set of mutually exclusive and exhaustive codes, but onset times are not preserved, it is often unclear how pairs of protocols should be aligned, yet such alignment is required before Cohen’s kappa, a common agreement statistic, can be computed. We describe a method—based on the Needleman and Wunsch ...
متن کاملInter-Observer Agreement in Measuring Respiratory Rate
BACKGROUND Respiratory rate (RR) is an important vital sign which is strongly correlated with in-hospital mortality. At the same time, RR is the most likely vital sign to be omitted when assessing a patient. We believe that one reason for this could be the difficulty in measure the RR, since it is not read off a monitor, but counted manually. Also there is the possibility of assessment bias and...
متن کاملInter-observer agreement in myelodysplastic syndromes.
We read with great interest the recent paper by Senent et al. and the accompanying editorial on the reproducibility of WHO 2008 criteria and inter-observer agreement regarding the assessment of dysplasia for diagnosis and classification of myelodysplastic syndromes (MDS). The reproducibility of any composite criteria is mainly based on both the constituting components and the precise manner in ...
متن کاملObserver agreement in evaluating coronary angiograms.
The reliability of interpretation of coronary arteriography as a diagnostic tool was investigated in a sub-study of the VA Cooperative Study of Surgical Treatment for Coronary Arterial Occlusive Disease. Twenty-two physicians with varying levels of experience read 13 cine angiograms -- blind -- on two different occasions. Analysis of inter- and intraobserver variability showed that angiographic...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Applied Behavior Analysis
سال: 1977
ISSN: 0021-8855
DOI: 10.1901/jaba.1977.10-133